Papers with human fact-checker
Complex Claim Verification with Evidence Retrieved in the Wild (2024.naacl-long)
Copied to clipboard
| Challenge: | Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: no access to evidence, access to curated evidence, or access to published evidence after a claim was made. |
| Approach: | They propose a pipeline to check claims using raw evidence from the web . they restrict their retriever to only search documents available prior to the claim's making . |
| Outcome: | The proposed method is based on a political claim dataset and shows that the evidence summary produced by the system is reliable and relevant to answering key questions. |
Estimating predictive uncertainty for rumour verification models (2020.acl-main)
Copied to clipboard
| Challenge: | Inability to correctly resolve rumours can have harmful real-world consequences. |
| Approach: | They propose a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour verification. |
| Outcome: | The proposed methods filter out erroneous model predictions and prioritise them for a human fact-checker. |